Augmented Reality for Robot Development and Experimentation

نویسندگان

  • Mike Stilman
  • Philipp Michel
  • Joel Chestnutt
  • Koichi Nishiwaki
  • Satoshi Kagami
  • James J. Kuffner
چکیده

The successful development of autonomous robotic systems requires careful fusion of complex subsystems for perception, planning, and control. Often these subsystems are designed in a modular fashion and tested individually. However, when ultimately combined with other components to form a complete system, unexpected interactions between subsystems can occur that make it difficult to isolate the source of problems. This paper presents a novel paradigm for robot experimentation that enables unified testing of individual subsystems while acting as part of a complete whole made up of both virtual and real components. We exploit the recent advances in speed and accuracy of optical motion capture to localize the robot, track environment objects, and extract extrinsic parameters for moving cameras in real-time. We construct a world model representation that serves as ground truth for both visual and tactile sensors in the environment. From this data, we build spatial and temporal correspondences between virtual elements, such as motion plans, and real artifacts in the scene. The system enables safe, decoupled testing of component algorithms for vision, motion planning and control that would normally have to be tested simultaneously on actual hardware. We show results of successful online applications in the development of an autonomous humanoid robot.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Augmented Reality System and Maintenance of Oil Pumps

Qualification of employees who operate technological processes directly influences the safety of production. However, the employees’’ qualification cannot completely exclude human factor. Today, there are many technologies that can minimize or eliminate human factor impact on production safety ensuring. The augmented reality technology is an example of this technology. Nowadays, the augmented r...

متن کامل

Application of Augmented and Virtual Reality Technologies in Medicine

Background and Aim: Virtual Reality and Augmented Reality are immersive technologies that integrate virtual and real-world elements. These technologies have been used to help and improve human capabilities in many fields. Virtual and augmented systems are used in various medical situations. They are effective options in most stages of patient treatment and performing medical procedures. Therefo...

متن کامل

Comparative Study between Hologram Technology and Augmented Reality

The great development witnessed by our current age has led to the emergence of many diverse modern technologies, one of these advanced technologies is Hologram technology and Augmented reality technology, These two technologies are somewhat similar to somewhat, as it can be said that they perform almost the same purpose, and at the same time, Hologram technology differs from augmented reality i...

متن کامل

Benefits of augmented reality function for laparoscopic and endoscopic surgical robot systems

Various surgical robotics need augmented reality functions for the extension of their abilities. To enhance the benefit of augmented reality for robotic surgery, two research experiences are described. One is the loading of the augmented reality function onto the laparoscopic surgical robot. The results of the clinical case where the commercial surgical robot da Vinch loaded with augmented real...

متن کامل

Improving Augmented Reality Visualisation for Mobile Robot Development

Developing mobile robot applications in the real world is difficult. ARDev is an open source tool designed to create a shared perceptual space for humans to see the world from a robots point of view. This is achieved by augmenting a live video feed with virtual objects resulting in an Augmented Reality visualisation toolkit used to visualise robot data. This project aims to expand and improve A...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005